Tracking People with Integrated Stereo, Color, and Face Detection
نویسندگان
چکیده
We present an approach to robust, real-time person tracking in crowded and/or unknown environments using multimodal integration. We combine stereo, color, and face detection modules into a single robust system, and show an initial application for an interactive display where the user sees his face distorted into various comic poses in real-time. Stereo processing is used to isolate the figure of a user from other objects and people in the background. Skin-hue classification identifies and tracks likely body parts within the foreground region, and face pattern detection discriminates and localizes the face within the tracked body parts. We discuss the failure modes of these individual components, and report results with the complete system in trials with thousands of users.
منابع مشابه
A Vision System for Personal Service Robots: Resilient Detection and Tracking of People
This report describes the design and implementation of a computer vision system that performs realtime people detection and tracking from stereo color video. The system, developed in the context of a project that aims to empower personal robots with advanced vision capabilities, illustrates a systematic approach to combining efficient but brittle algorithms into robust systems. The system’s tra...
متن کاملPeople detection and tracking using stereo vision and color
Introduction The system presented by this paper is designed to take advantage of newer stereo cameras to improve person detection and tracking. Additionally, color information is used to create a more robust tracking system. Finally, all of this must be done quickly so the system can be used in real time applications. Stereo camera system (instead of the popular single camera system) Color info...
متن کاملRobust Visual Person Tracking for Interactive Displays
We present an approach to real-time person tracking in crowded and/or unknown environments using integration of multiple visual modalities. We combine stereo, color, and face detection modules into a single robust system, and show an initial application in an interactive, faceresponsive display. Dense, real-time stereo processing is used to isolate users from other objects and people in the bac...
متن کاملVideo Display Classification of Identity Normalization for scale and alignment Skin and Hair color Description Height Computation Selection of face
We present an approach to real-time person tracking in crowded and/or unknown environments using multi-modal integration. We combine stereo, color, and face detection modules into a single robust system, and show an initial application in an interactive, face-responsive display. Dense, real-time stereo processing is used to isolate users from other objects and people in the background. Skin-hue...
متن کاملMulti-camera Person Tracking in a Cluttered Interaction Environment
Tracking the head and hand in real-time are important tasks for developing an intuitive interaction system. We present a system for robust probabilistic tracking that integrates face detection, face and hand color tracking and foot tracking in a uniform way by using particle filters. The advantages of different cues like motion, color and face detection are combined to yield robust 2D and 3D po...
متن کامل